<html>
<head>
    <title>METviewer Documentation</title>
    <link rel="stylesheet" type="text/css" href="mv_doc.css"/>
    <link rel="shortcut icon" href="include/ral_icon.ico" type="image/x-icon"/>
</head>
<body>

<p class="loc" style="padding-top:10px">
    <b>Location:</b> <a class="loc" href="index.html">Home</a> &#187; Batch Plotting
</p>
<hr/>

<h2>METviewer Documentation - Batch Plotting Module</h2>

<p>The batch plotting system is used to generate a number of plots of data in the METviewer
    database. The usage statement:</p>

<p class="term">
    ---- MVBatch ----<br/><br/>
    Usage: mv_batch<br/>
    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[-list]<br/>
    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[-printSql]<br/>
    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;plot_spec_file<br/>
    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[job_name]<br/><br/>
    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;where "-list" indicates that the available plot jobs
    should be listed and no plots run<br/>
    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"-printSql" print
    SQL statements<br/>
    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"plot_spec_file"
    specifies the XML plot specification document<br/>
    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;"job_name" specifies
    the name of the job from the plot specification to run<br/><br/>
    ---- MVBatch Done ----<br/>
</p>

<p>
    The <span class="term">plot_spec_file</span> passed to the batch module contains information about the plots that
    will be generated. It is an XML file whose
    top-level tag is <span class="code">&lt;plot_spec&gt;</load_spec></span> which contains the following elements,
    divided into functional sections.<br/>
    <span class="code">NOTE:</span> All <span class="code">&lt;val&gt;</span> elements should be listed in alphabetical
    order.

    <ul>
        <li><span class="code">&lt;connection&gt;</span> see <a href="common_xml.html">common xml</a></li>
        <br/>

        <li><span class="code">&lt;rscript&gt;</span> (optional) specifies the Rscript instance to use, for example
            <span class="term">/usr/local/bin/Rscript</span>, defaults
            to the instance on the user path
        </li>
        <br/>

        <li>
            <span class="code">&lt;folders&gt;</span>: a structure that specifies the input and output file system
            folders
            <ul>
                <li><span class="code">&lt;r_tmpl&gt;</span>: the folder that contains the R templates used
                    by METviewer, typically <span class="term">R_tmpl/</span> from the metviewer
                    CVS source tree
                <li><span class="code">&lt;r_work&gt;</span>: the folder that will contain the data and generated R
                    scripts, must contain the sub-folder <span class="term">include/</span>
                <li><span class="code">&lt;plots&gt;</span>: the output folder that will contain the generated plots
                </li>
            </ul>
        </li>
        <br/>

        <li><span class="code">&lt;date_list&gt;</span> see <a href="common_xml.html">common xml</a></li>
        <br/>

        <li>
            <span class="code">&lt;date_range&gt;</span>: a structure that specifies a date range, including all dates
            and times between
            <ul>
                <li><span class="code">&lt;start&gt;</span>: the start date and time of the date list, specified in the
                    format yyyy-MM-dd [HH:mm:ss], or with a
                    <span class="code">&lt;date_offset&gt;</span> structure (see <a href="common_xml.html">common
                        xml</a>)
                </li>
                <li><span class="code">&lt;end&gt;</span>: the end date and time of the date list, specified in the
                    format yyyy-MM-dd [HH:mm:ss], or with a
                    <span class="code">&lt;date_offset&gt;</span> structure (see <a href="common_xml.html">common
                        xml</a>)
                </li>
            </ul>
        </li>
        <br/>

        <li>
            <span class="code">&lt;date_range_list&gt;</span>: a structure that specifies a list of date ranges,
            conceptually, a list of <span class="code">&lt;date_range&gt;</span>
            structures
            <ul>
                <li><span class="code">&lt;range_start&gt;</span>: the start date and time of the first date range of
                    the list, specified in the format yyyy-MM-dd [HH:mm:ss], or with a
                    <span class="code">&lt;date_offset&gt;</span> structure (see <a href="common_xml.html">common
                        xml</a>)
                </li>
                <li><span class="code">&lt;range_end&gt;</span>: the start date and time of the last date range of the
                    list, specified in the format yyyy-MM-dd [HH:mm:ss], or with a
                    <span class="code">&lt;date_offset&gt;</span> structure (see <a href="common_xml.html">common
                        xml</a>)
                </li>
                <li><span class="code">&lt;range_length&gt;</span>: the range length, in minutes</li>
                <li><span class="code">&lt;inc&gt;</span>: the increment, in minutes, between the end of the previous
                    range member and the start of the next
                </li>
            </ul>
        </li>
        <br/>

        <li>
            <span class="code">&lt;plot&gt;</span>: a structure that specifies plot characteristics and may inherit
            characteristics from other <span class="code">&lt;plot&gt;</span>
            structures
            <br/><b>Attributes:</b>
            <ul style="list-style-image:url('att_bullet.gif')">
                <li><span class="code">name</span>: name for the plot structure, used when plot's characteristics are
                    inherited by later <span class="code">&lt;plot&gt;</span> structures
                </li>
                <li><span class="code">inherits</span>: name of one or more <span class="code">&lt;plot&gt;</span>
                    structures whose characteristics to inherit, separated by commas (no spaces);
                    plots named later on the list override the characteristics of those earlier on the list
                </li>
                <li><span class="code">run</span>: (optional) <span class="code">true</span> or <span
                        class="code">false</span>, specifying whether or not to run this plot job
                </li>
            </ul>
            <br/>

            <ul>
                <a name="template"></a>
                <li>
                    <span class="code">&lt;template&gt;</span>: the name of the R plot script template to use. The
                    following templates are currently supported:
                    <ul>
                        <li><span class="term">series_plot.R_tmpl</span>: use for time series, threshold series, date
                            series and other series type plots
                            which display a fcst_var and statistic vs. a stat_header quantity
                        </li>
                        <li><span class="term">bar_plot.R_tmpl</span>: use for bar plots of fcst_var/statistic vs.
                            stat_header quantities
                        </li>
                        <li><span class="term">box_plot.R_tmpl</span>: use for box plots of fcst_var/statistic vs.
                            stat_header quantities
                        </li>
                        <li><span class="term">rhist.R_tmpl</span>: use for ensemble rank histograms, only fixed data
                            must be specified
                        </li>
                        <li><span class="term">roc.R_tmpl</span>: use for ROC plots, only fixed data and PCT/CTC data
                            must be specified
                        </li>
                        <li><span class="term">rely.R_tmpl</span>: use for reliability diagrams, only fixed data must be
                            specified
                        </li>
                        <li><span class="term">ens_ss.R_tmpl</span>: use ensemble spread/skill diagrams, fixed data and
                            series must be specified
                        </li>
                    </ul>


                </li>
                <br/>

                <a name="indep"></a>
                <li><span class="code">&lt;indep&gt;</span>: a structure that defines the independent variable and its
                    values for the plot
                    <br/><b>Attributes:</b>
                    <ul style="list-style-image:url('att_bullet.gif')">
                        <li><span class="code">name</span>: database field name of the independent variable</li>
                        <li><span class="code">depends</span>: the field name of one of the plot_fix field structures;
                            will be used to calculate independent variable values
                        </li>
                    </ul>
                    <br/>

                    <ul>
                        <li><span class="code">&lt;val&gt;</span>: a single value
                            <br/><b>Attributes:</b>
                            <ul style="list-style-image:url('att_bullet.gif')">
                                <li><span class="code">label</span>: (optional) x-axis label</li>
                                <li><span class="code">plot_val</span>: (optional) x-axis position</li>
                            </ul>
                            <br/>
                        </li>
                        <li>
                            <span class="code">&lt;date_list&gt;</span>: a structure that specifies a list of date
                            strings in a certain format
                            <ul>
                                <li><span class="code">&lt;start&gt;</span>: the start date and time of the date list,
                                    specified in the format yyyy-MM-dd HH:mm:ss
                                </li>
                                <li><span class="code">&lt;end&gt;</span>: the end date and time, specified in the
                                    format yyyy-MM-dd HH:mm:ss
                                </li>
                                <li><span class="code">&lt;inc&gt;</span>: the increment, in seconds, between successive
                                    members of the date list
                                </li>
                                <li><span class="code">&lt;label_format&gt;</span>: the date format, specified by the
                                    java class
                                    <a href="https://docs.oracle.com/javase/8/docs/api/java/text/SimpleDateFormat.html">SimpleDateFormat</a>
                                </li>
                            </ul>
                        </li>
                    </ul>
                </li>
                <br/>

                <a name="series"></a>
                <li><span class="code">&lt;series1&gt;</span>: describes the database field names and values that
                    constitute the various lines, or series, corresponding to
                    the left y axis (y1-axis) of the plot<br/>
                    <ul>
                        <li><span class="code">&lt;field&gt;</span>: a database field whose values constitute the
                            members of the series
                            <br/><b>Attributes:</b>
                            <ul style="list-style-image:url('att_bullet.gif')">
                                <li><span class="code">name</span>: the database field name whose values are contained
                                    in the child tags
                                </li>
                            </ul>
                            <br/>

                            <ul>
                                <li><span class="code">&lt;val&gt;</span>: a single value</li>
                            </ul>
                        </li>
                    </ul>
                </li>
                <br/>

                <li><span class="code">&lt;series2&gt;</span>: describes the database field names and values that
                    constitute the various lines, or series, corresponding to
                    the right y axis (y2-axis) of the plot; the structure is the same as <span class="code">&lt;series1&gt;</span>
                    above
                </li>
                <br/>

                <a name="series_nobs"></a>
                <li><span class="code">&lt;series_nobs&gt;</span>: indicates which database fields should be used to
                    calculate the number of observations for the plot, or NOBS
                </li>
                <br/>

                <a name="dep_scale"></a>
                <li><span class="code">&lt;dep1_scale&gt;</span> or <span class="code">&lt;dep2_scale&gt;</span>:
                    specifies a scale factor for a fcst_var/stat pair, for example
                    to convert the units of a statistic

                    <ul>
                        <li><span class="code">&lt;field&gt;</span>: contains the value of the scalar to apply
                            <br/><b>Attributes:</b>
                            <ul style="list-style-image:url('att_bullet.gif')">
                                <li><span class="code">name</span>: the fcst_var/stat name pair in the format
                                    [fcst_var]_[stat]
                                </li>
                            </ul>
                            <br/>
                        </li>
                    </ul>
                </li>
                <br/>

                <a name="plot_fix"></a>
                <li><span class="code">&lt;plot_fix&gt;</span>: describes the database fields and values that are
                    constant on a given plot, or fixed. Each permutation of
                    <span class="term">plot_fix</span> field values will be used to create a database query and all
                    plots will be run with the resulting data held constant. The
                    fields can be used in the <span class="term">tmpl</span> values, described below, to create paths,
                    filenames and labels for the plots.
                    <ul>
                        <li><span class="code">&lt;field&gt;</span>: a database field whose values constitute the
                            members of the series
                            <br/><b>Attributes:</b>
                            <ul style="list-style-image:url('att_bullet.gif')">
                                <li><span class="code">name</span>: the database field name whose values are contained
                                    in the child tags
                                </li>
                                <li><span class="code">equalize</span>: <span class="code">TRUE</span> or <span class="code">FALSE</span>,
                                    indicating whether or not to include this field to the Event Equalisation case
                                </li>
                            </ul>
                            <br/>

                            <ul>
                                <li><span class="code">&lt;val&gt;</span>: a single value</li>
                                <li><span class="code">&lt;date_list&gt;</span>: refers to a previously declared <span
                                        class="code">&lt;date_list&gt;</span>, using the name attribute
                                    (see <a href="common_xml.html">common xml</a>)
                                </li>
                                <li><span class="code">&lt;date_range&gt;</span>: refers to a previously declared <span
                                        class="code">&lt;date_range&gt;</span>, using the name attribute
                                    (see <a href="common_xml.html">common xml</a>)
                                </li>
                                <li><span class="code">&lt;date_range_list&gt;</span>: refers to a previously declared
                                    <span class="code">&lt;date_range_list&gt;</span>, using the name
                                    attribute (see <a href="common_xml.html">common xml</a>)
                                </li>

                                <li><span class="code">&lt;set&gt;</span>: a set of values
                                    <br/><b>Attributes:</b>
                                    <ul style="list-style-image:url('att_bullet.gif')">
                                        <li><span class="code">name</span>: (optional) name of the set, used in the
                                            field template
                                        </li>
                                    </ul>
                                    <br/>
                                    <span style="padding-left:20px">A set can contain one or more of the following:</span><br/>
                                    <ul>
                                        <li><span class="code">&lt;val&gt;</span>: a single value</li>
                                        <li><span class="code">&lt;date_list&gt;</span>: refers to a previously declared
                                            <span class="code">&lt;date_list&gt;</span>, using the name attribute
                                            (see <a href="common_xml.html">common xml</a>)
                                        </li>
                                    </ul>
                                </li>


                            </ul>
                        </li>
                    </ul>
                </li>
                <br/>

                <a name="plot_cond"></a>
                <li><span class="code">&lt;plot_cond&gt;</span>: contains a SQL clause that will be inserted with the
                    clause generated by the <span class="code">&lt;plot_fix&gt;</span>
                    information, allowing a user to specify record conditions for plotted statistics. Examples include:
                    <ul>
                        <li><span class="term">&lt;plot_cond&gt;ld.baser &gt; 0.02&lt;/plot_cond&gt;</span></li>
                    </ul>
                </li>
                <br/>

                <a name="agg"></a>
                <li><span class="code">&lt;agg&gt;</span>: this tag has been replaced by <span class="code">&lt;plot_fix&gt;</span>.
                    Do not use <span class="code">&lt;agg&gt;</span>.
                </li>
                <br/>

                <a name="tmpl"></a>
                <li><span class="code">&lt;tmpl&gt;</span>:
                    <ul>
                        <li><span class="code">&lt;val_map&gt;</span>: a map of key/value pairs used for when templates
                            are populated
                            <br/><b>Attributes:</b>
                            <ul style="list-style-image:url('att_bullet.gif')">
                                <li><span class="code">name</span>: the database field name whose values should be
                                    mapped using the enclosed pairs
                                </li>
                            </ul>
                            <br/>

                            <ul>
                                <li><span class="code">&lt;pair&gt;</span>: a single value pair
                                    <ul>
                                        <li><span class="code">&lt;key&gt;</span>: the template field value, as taken
                                            from the database
                                        </li>
                                        <li><span class="code">&lt;val&gt;</span>: the value to use as a replacement
                                        </li>
                                    </ul>
                                </li>
                            </ul>
                        </li>
                        <br/>
                        <li><span class="code">&lt;data_file&gt;</span>: path and name of the R data.frame data file,
                            inside of the <span class="code">&lt;r_work&gt;</span> folder
                            specified above
                        </li>
                        <li><span class="code">&lt;plot_file&gt;</span>: path and name of the output plot image file,
                            inside of the <span class="code">&lt;plots&gt;</span> folder
                            specified above
                        </li>
                        <li><span class="code">&lt;r_file&gt;</span>: path and name of the R script that generates the
                            plot, inside of the <span class="code">&lt;r_work&gt;</span>
                            folder specified above
                        </li>
                        <li><span class="code">&lt;title&gt;</span>: title that will be placed on top of the plot</li>
                        <li><span class="code">&lt;x_label&gt;</span>: x-axis label that will be placed on the plot</li>
                        <li><span class="code">&lt;y1_label&gt;</span>: left y axis (y1-axis) label that will be placed
                            on the plot
                        </li>
                        <li><span class="code">&lt;y2_label&gt;</span>: right y axis (y2-axis) label that will be placed
                            on the plot
                        </li>
                        <li><span class="code">&lt;caption&gt;</span>: caption that will be placed on the bottom of the
                            plot
                        </li>
                        <li><span class="code">&lt;listDiffSeries1&gt;</span>: turns on a difference curve should be
                            plotted for the y1 series; calculated as the pairwise difference between the members of the
                            first series minus the second - example:<span class="term">list(c("series1","series2"), c("series3","series4"))</span>
                        </li>
                        <li><span class="code">&lt;listDiffSeries2&gt;</span>: turns on a difference curve should be
                            plotted for the y2 series; calculated as the pairwise difference between the members of the
                            first series minus the second - example:<span class="term">list(c("series1","series2"), c("series3","series4"))</span>
                        </li>
                    </ul>

                    <h4 style="padding-left:40px; text-decoration:underline; font-weight:normal">Template
                        Formatting</h4>
<p style="padding-left:40px">
    Template values have the syntax <span class="term">{var_name[?param1=val1[&amp;amp;param2=val2[...]]]}</span>. For
    example, <span class="term">{fcst_lead?format=HH}</span>
    or <span class="term">{vx_mask?map=masks}</span> or <span
        class="term">{fcst_thresh?units=in&amp;amp;symbol=letters}</span>. The var_name must be one of the database
    fields
    that is used in the plot fixed variables or agg variables. When the template is applied, the current plot values for
    each variable replaces the tag in the template.
    The parameters can be used to format, convert or map the values. The dependent variables forecast variables are
    represented using the syntax
    <span class="term">{depY_N}</span>, where Y is the y-axis (either 1 or 2) and N is the index of the fcst_var in the
    <span class="code">&lt;dep&gt;</span> structure,
    starting with 1. The dependent variable statistics are represented using the syntax <span class="term">{depY_N_statS}</span>,
    where Y and N match the values of the
    parent fcst_var, and S is the index of the statistic, starting at 1 for each fcst_var.
</p>
<ul>
    <li><span class="code">map=[name]</span>: indicates that the template <span class="code">&lt;val_map&gt;</span>
        structure with the given name should be applied
    </li>
    <li><span class="code">format=[format_type]</span>: depending on the variable being formatted the following options
        apply:<br/>
        <ul>
            <li><span class="code">fcst_lead</span>: use HH for the two-character wide hour, HHmm for the four-character
                hour and minute
            </li>
            <li><span class="code">init_hour</span> or <span class="code">valid_hour</span>: use HH for the
                two-character wide hour <span class="code">init_hour</span></li>
            <li><span class="code">fcst_thresh</span>, <span class="code">fcst_thr</span>, <span
                    class="code">obs_thresh</span> or <span class="code">obs_thr</span>:
                apply the specified decimal format to the threshold value, accoring to the formatting syntax for the
                java class
                <a href="http://download.oracle.com/javase/1.4.2/docs/api/java/text/DecimalFormat.html">DecimalFormat</a>
            </li>
        </ul>
        <span style="padding-left:15px">For any variable, <span class="term">format=R</span> will replace all non-variable characters (like &lt;, = and .) with
						appropriate letters and underscores.</span>
    </li>
    <li><span class="code">units=in</span>: can only be used if the variable is a threshold, converts the threshold
        value to inches from mm
    </li>
    <li><span class="code">symbol=letters</span>: can only be used if the variable is a threshold, converts the
        threshold criteria to FORTRAN-like letters,
        e.g. &gt;= becomes ge
    </li>
</ul>
</li><br/>

<a name="dep"></a>
<li><span class="code">&lt;dep&gt;</span>: information about the dependent variables of the plot. Each curve of the plot
    is assumed to have a constant fcst_var and
    constant statistic. The stats plotted on the two dependent axes (y1 and y2) are specified using the identical <span
            class="term">dep1</span> and
    <span class="term">dep2</span> structures. Fixed values, which correspond to each fcst_var, are specified using the
    <span class="term">fix</span> structure. The
    <a href="#mode_stat">MODE statistics</a> documentation can be viewed below on this page.
    <ul>
        <li><span class="code">&lt;dep1&gt;</span>: the fcst_var/stat pairs for the first dependent axis (y1)
            <ul>
                <li><span class="code">&lt;fcst_var&gt;</span>: the fcst_var for which the enclosed list of stats will
                    be plotted
                    <br/><b>Attributes:</b>
                    <ul style="list-style-image:url('att_bullet.gif')">
                        <li><span class="code">name</span>: the fcst_var whose statistics will be plotted
                    </ul>
                    <br/>
                    <ul>
                        <li><span class="code">&lt;stat&gt;</span>: the name of the stat to plot, whose name must be
                            identical to the name in the MET User's Guide
                        </li>
                    </ul>
                </li>
            </ul>
        </li>
        <br/>
        <li><span class="code">&lt;dep2&gt;</span>: the fcst_var/stat pairs for the second dependent axis (y2), whose
            structure is identical to that of <span class="code">&lt;dep1&gt;</span>
        <li><span class="code">&lt;fix&gt;</span>: do not use <span class="code">&lt;fix&gt;</span>, use <span
                class="code">&lt;plot_fix&gt;</span> instead
        </li>
    </ul>
</li>
<br/>

<a name="boot"></a>
<li><span class="code">&lt;bootstrapping&gt;</span>: replaced by <span class="code">&lt;agg_stat&gt;</span>, do not use
    <span class="code">&lt;bootstrapping&gt;</span>
</li>
<br/>

<a name="agg_stat"></a>
<li><span class="code">&lt;agg_stat&gt;</span>: contains information about how to calculate and display aggregated
    statistics. If present, agg_stat is
    turned on. Depending on the selected <span class="code">&lt;dep&gt;</span> statistics, only certain settings are
    appropriate.</br>
    <ul>
        <li><span class="code">&lt;agg_ctc&gt;</span>: <span class="code">TRUE</span> or <span class="code">FALSE</span>,
            indicating whether or not to aggregate CTCs
        </li>
        <li><span class="code">&lt;agg_sl1l2&gt;</span>: <span class="code">TRUE</span> or <span
                class="code">FALSE</span>, indicating whether or not to aggregate SL1L2s
        </li>
        <li><span class="code">&lt;agg_sal1l2&gt;</span>: <span class="code">TRUE</span> or <span
                class="code">FALSE</span>, indicating whether or not to aggregate SAL1L2s
        </li>
        <li><span class="code">&lt;agg_pct&gt;</span>: <span class="code">TRUE</span> or <span class="code">FALSE</span>,
            indicating whether or not to aggregate PCTs
        </li>
        <li><span class="code">&lt;agg_nbrcnt&gt;</span>: <span class="code">TRUE</span> or <span
                class="code">FALSE</span>, indicating whether or not to aggregate NBR_CNTs
        </li>
        <li><span class="code">&lt;agg_ssvar&gt;</span>: <span class="code">TRUE</span> or <span
                class="code">FALSE</span>, indicating whether or not to aggregate SSVARs
        </li>
        <li><span class="code">&lt;agg_vl1l2&gt;</span>: <span class="code">TRUE</span> or
            <span class="code">FALSE</span>, indicating whether or not to aggregate VL1L2s
        </li>
        <li><span class="code">&lt;agg_val1l2&gt;</span>: <span class="code">TRUE</span> or
            <span class="code">FALSE</span>, indicating whether or not to aggregate Vector
            Anomaly Partial Sums
        </li>
        <li><span class="code">&lt;agg_grad&gt;</span>: <span class="code">TRUE</span> or <span
                class="code">FALSE</span>, indicating whether or not to aggregate GRADs
        </li>
        <li><span class="code">&lt;boot_repl&gt;</span>: number of bootstrapping replications, use 1 for no
            bootstrapping
        </li>
        <li><span class="code">&lt;boot_random_seed"&gt;</span>: bootstrapping seed</li>
        <li><span class="code">&lt;boot_ci&gt;</span>: type of confidence interval to calculate, passed to boot.ci() R
            function (e.g. bca)
        </li>

        <li><span class="code">&lt;cache_agg_stat&gt;</span>: <span class="code">true</span> or <span
                class="code">false</span>, turns on/off the prevention the reuse of existing bootstrapping output data
        </li>
    </ul>
    <br/>
    <span style="padding-left:30px">When using <span class="code">&lt;agg_stat&gt;</span>, the following constraints and conditions apply:</span>
    <ul>
        <li>to turn off bootstrapping, set <span class="code">&lt;boot_repl&gt;</span> to 1</li>
        <li>agg_stat types must only be used with appropriate statistics for each, and only one can be used on a single
            plot
        </li>
        <li>agg_stat is performed once for each plot that is created</li>
        <li>a plot cannot have both agg_stat and non-agg_stat data on the same plot</li>
        <li>if the agg_stat difference curve is turned on, the plot1 difference curve must be turned off</li>
        <li>to display the calculated bootstrap CIs, set the plot_cis to "boot"</li>
        <li>bootstrapping CIs cannot be calculated for PSTD stats, instead use the "brier" CI type for Brier score</li>
        <li>the plot must contain statistics for only one fcst_var</li>
        <li>all series on the plot must be derived from the same data</li>
        <li>if agg_stat is turned on, event equalization must be turned off (it is done automatically)</li>
        <li>agg_stat cannot be used on the same plot with calc_stat</li>
    </ul>
</li>
<br/>


<a name="calc_stat"></a>
<li><span class="code">&lt;calc_stat&gt;</span>: contains flags telling METviewer to
    calculate the plot statistics from CTCs or partial sums. If present, calc_stat is
    turned on. Depending on the selected <span class="code">&lt;dep&gt;</span> statistics, only certain settings are
    appropriate.</br>
    <ul>
        <li><span class="code">&lt;calc_ctc&gt;</span>: <span class="code">TRUE</span> or <span
                class="code">FALSE</span>, indicating whether or not to calculate CTC stats
        </li>
        <li><span class="code">&lt;calc_sl1l2&gt;</span>: <span class="code">TRUE</span> or <span
                class="code">FALSE</span>, indicating whether or not to calculate SL1L2 stats
        </li>
        <li><span class="code">&lt;calc_sal1l2&gt;</span>: <span class="code">TRUE</span> or <span
                class="code">FALSE</span>, indicating whether or not to calculate SAL1L2 stats
        </li>
        <li><span class="code">&lt;calc_vl1l2&gt;</span>: <span class="code">TRUE</span> or <span
                class="code">FALSE</span>, indicating whether or not to calculate VL1L2 stats
        </li>
    </ul>
    <br/>
    <span style="padding-left:30px">When using <span class="code">&lt;calc_stat&gt;</span>, the following constraints apply:</span>
    <ul>
        <li>calc_ctc, calc_sl1l2, calc_sal1l2, calc_vl1l2 must only be used with appropriate statistics for each, and
            only one can be used on a single plot
        </li>
        <li>a plot cannot have both calc_stat and non-calc_stat data on the same plot</li>
        <li>calc_stat cannot be used on the same plot with agg_stat</li>
    </ul>
</li>
<br/>

<a name="roc_calc"></a>
<li><span class="code">&lt;roc_calc&gt;</span>: contains flags telling METviewer how to
    calculate the points on the ROC curve: from PCTs or CTCs. This setting is required
    if the roc.R_tmpl is used, otherwise, it is ignored.</br>
    <ul>
        <li><span class="code">&lt;roc_pct&gt;</span>: <span class="code">TRUE</span> or <span class="code">FALSE</span>,
            indicating whether or not to calculate ROC points
            using Probabilistic Contingency Table Counts (PCTs)
        </li>
        <li><span class="code">&lt;roc_ctc&gt;</span>: <span class="code">TRUE</span> or <span class="code">FALSE</span>,
            indicating whether or not to calculate ROC points
            using Contingency Table Counts (CTCs)
        </li>
    </ul>
    <br/>
    <span style="padding-left:30px">When using <span class="code">&lt;roc_calc&gt;</span>, the following constraints apply:</span>
    <ul>
        <li>only one of roc_pct or roc_ctc can be used on a single plot</li>
        <li>if using roc_pct, select a list of probabilistic threshold values as a fcst_thresh <span class="code">&lt;plot_fix&gt;</span>
            value
        </li>
        <li>if using roc_pct, select a single obs_thresh <span class="code">&lt;plot_fix&gt;</span> value</li>
        <li>if using roc_ctc, select two or more fcst_thresh <span class="code">&lt;plot_fix&gt;</span> values and a
            single obs_thresh
            <span class="code">&lt;plot_fix&gt;</span> value
        </li>
    </ul>
</li>
<br/>

<a name="hist_type"></a>
<li><span class="code">&lt;normalized_histogram&gt;</span>: contains flags
    telling METviewer which type of histogram to built: normalized or raw counts plot. This setting is required
    if the rhist.R_tmpl is used, otherwise, it is ignored.The default value is TRUE (normalized histogram).</br>
    <ul>
        <li><span class="code">&lt;normalized_histogram&gt;</span>: <span class="code">TRUE</span> or <span
                class="code">FALSE</span>, indicating whether to build a normalized or raw counts histogram
        </li>

    </ul>
    <br/>

</li>
<br/>

<a name="ensss_pts"></a>
<li><span class="code">&lt;ensss_pts&gt;</span>: number of binned points.</li>
<ul>
    <li>If the number of binned points is not specified or &lt; 1, use a default</li>
    <li>If the number of binned points is &gt; 10 , use 1</li>
    <li>in other cases use the result of division of number of points on 10</li>
</ul>

<br/>
<a name="fmt_bool"></a>
<li><span class="code">&lt;execution_type&gt;</span>: <span class="code">Rscript</span> or
    <span class="code">Python</span>, indicating whether to use Rscript ot Python for the statistics
    calculation and plotting (if available). This is optional element. The default value is Rscript
</li>
<li><span class="code">&lt;event_equal&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    turns on the event equalizer
</li>
<li><span class="code">&lt;event_equal_m&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    turns on the event equalizer for multiple events
</li>
<li><span class="code">&lt;vert_plot&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    turns on vertical levels plotting
</li>
<li><span class="code">&lt;x_reverse&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    reverse the direction of the x-axis
</li>

<li><span class="code">&lt;num_stats&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    turns on the number of stats for each independent
    variable value, shown along the x2 axis
</li>
<li><span class="code">&lt;indy1_stag&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    indicates whether y1 series points should be
    staggered at each independent variable value, for visibility
</li>
<li><span class="code">&lt;indy2_stag&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    indicates whether y2 series points should be
    staggered at each independent variable value, for visibility
</li>
<li><span class="code">&lt;grid_on&gt;</span>: <span class="code">true</span> or <span class="code">false</span>, turns
    on gridding on the plot
</li>
<li><span class="code">&lt;sync_axes&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    indicates that the y1 and y2 axes should be the same
</li>
<li><span class="code">&lt;dump_points1&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    turns on a report for the y1 series points
</li>
<li><span class="code">&lt;dump_points2&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    turns on a report for the y2 series points
</li>
<li><span class="code">&lt;log_y1&gt;</span>: <span class="code">true</span> or <span class="code">false</span>, turns
    on log-scale on the y1 axis
</li>
<li><span class="code">&lt;log_y2&gt;</span>: <span class="code">true</span> or <span class="code">false</span>, turns
    on log-scale on the y2 axis
</li>
<li><span class="code">&lt;varianceInflationFactor&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    include/exclude the variance inflation factor when computing standard errors for means and medians - TRUE: include,
    FALSE: exclude - default value: <span class="term">TRUE</span></li>
<li><span class="code">&lt;order_series&gt;</span>: <span class="code">true</span> or <span class="code">false</span>,
    include/exclude the variance inflation factor when computing standard errors for means and medians - TRUE: include,
    FALSE: exclude - default value: <span class="term">TRUE</span></li>
<br/>

<a name="fmt_txt"></a>
The following group of settings are each optional and act as placeholders for R plotting function arguments. Specified
values should follow the format of the default
values listed. The values are passed directly to plotting functions which can be viewed in the R template files for
further details. The R function and parameter
name that the value is used for is listed after the tag name below. The default value is also shown for each
setting.<br/><br/>

<li><span class="code">&lt;plot_type&gt;</span>: <span class="term">bitmap(type)</span> - plot image type - default
    value: <span class="term">png256</span>
<li><span class="code">&lt;plot_height&gt;</span>: <span class="term">bitmap(height)</span> - height of the display
    region, in specified units - default value: <span class="term">8.5</span></li>
<li><span class="code">&lt;plot_width&gt;</span>: <span class="term">bitmap(width)</span> - width of the display region,
    in specified units - default value: <span class="term">11</span></li>
<li><span class="code">&lt;plot_res&gt;</span>: <span class="term">bitmap(res)</span> - resolution, in dots per inch -
    default value: <span class="term">72</span></li>
<li><span class="code">&lt;plot_units&gt;</span>: <span class="term">bitmap(units)</span> - units for height and width -
    default value: <span class="term">in</span></li>
<li><span class="code">&lt;mar&gt;</span>: <span class="term">par(mar)</span> - lines of margin in form c(bottom, left,
    top, right) - default value: <span class="term">c(8, 4, 5, 4)</span></li>
<li><span class="code">&lt;mgp&gt;</span>: <span class="term">par(mgp)</span> - margin line for axis title, axis labels
    and axis line in form c(title, labels, line) - default value: <span class="term">c(1, 1, 0)</span></li>
<li><span class="code">&lt;cex&gt;</span>: <span class="term">par(cex)</span> - magnification for plot text - default
    value: <span class="term">1</span></li>
<li><span class="code">&lt;title_weight&gt;</span>: <span class="term">mtext(font)</span> - 1: plain text, 2: bold, 3:
    italic, 4: bold italic and 5: symbol - default value: <span class="term">2</span></li>
<li><span class="code">&lt;title_size&gt;</span>: <span class="term">mtext(cex)</span> - relative magnification -
    default value: <span class="term">1.4</span></li>
<li><span class="code">&lt;title_offset&gt;</span>: <span class="term">mtext(padj)</span> - axis label perpendicular
    location adjustment - default value: <span class="term">-.4</span></li>
<li><span class="code">&lt;title_align&gt;</span>: <span class="term">mtext(adj)</span> - axis label parallel location
    adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;xtlab_orient&gt;</span>: <span class="term">axis(las)</span> - axis label orientation - 0:
    parallel to axis, 1: horiz, 2: perp to axis, 3: vert - default value: <span class="term">1</span></li>
<li><span class="code">&lt;xtlab_perp&gt;</span>: <span class="term">axis(padj)</span> - axis label perpendicular
    location adjustment - default value: <span class="term">-.75</span></li>
<li><span class="code">&lt;xtlab_horiz&gt;</span>: <span class="term">axis(hadj)</span> - axis label parallel location
    adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;xtlab_freq&gt;</span>: <span class="term">axis(labels)</span> - frequency of axis labels, 0
    to disable - default value: <span class="term">0</span></li>
<li><span class="code">&lt;xtlab_size&gt;</span>: <span class="term">axis(cex)</span> - relative axis label
    magnification - default value: <span class="term">1</span></li>
<li><span class="code">&lt;xlab_weight&gt;</span>: <span class="term">mtext(font)</span> - 1: plain text, 2: bold, 3:
    italic, 4: bold italic and 5: symbol - default value: <span class="term">1</span></li>
<li><span class="code">&lt;xlab_size&gt;</span>: <span class="term">mtext(cex)</span> - relative axis label
    magnification - default value: <span class="term">1</span></li>
<li><span class="code">&lt;xlab_offset&gt;</span>: <span class="term">mtext(padj)</span> - axis label perpendicular
    location adjustment - default value: <span class="term">2</span></li>
<li><span class="code">&lt;xlab_align&gt;</span>: <span class="term">mtext(adj)</span> - axis label parallel location
    adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;ytlab_orient&gt;</span>: <span class="term">axis(las)</span> - axis label orientation - 0:
    parallel to axis, 1: horiz, 2: perp to axis, 3: vert - default value: <span class="term">1</span></li>
<li><span class="code">&lt;ytlab_perp&gt;</span>: <span class="term">axis(padj)</span> - axis label perpendicular
    location adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;ytlab_horiz&gt;</span>: <span class="term">axis(hadj)</span> - axis label parallel location
    adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;ytlab_size&gt;</span>: <span class="term">axis(cex)</span> - relative axis label
    magnification - default value: <span class="term">1</span></li>
<li><span class="code">&lt;ylab_weight&gt;</span>: <span class="term">mtext(font)</span> - 1: plain text, 2: bold, 3:
    italic, 4: bold italic and 5: symbol - default value: <span class="term">1</span></li>
<li><span class="code">&lt;ylab_size&gt;</span>: <span class="term">mtext(cex)</span> - relative axis label
    magnification - default value: <span class="term">1</span></li>
<li><span class="code">&lt;ylab_offset&gt;</span>: <span class="term">mtext(padj)</span> - axis label perpendicular
    location adjustment - default value: <span class="term">-2</span></li>
<li><span class="code">&lt;ylab_align&gt;</span>: <span class="term">mtext(adj)</span> - axis label parallel location
    adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;grid_lty&gt;</span>: <span class="term">abline(lty)</span> - line type - 0: blank, 1: solid,
    2: dashed, 3: dotted, 4: dotdash, 5: longdash, 6: twodash - default value: <span class="term">3</span></li>
<li><span class="code">&lt;grid_col&gt;</span>: <span class="term">abline(col)</span> - line color - default value:
    <span class="term">#CCCCCC</span></li>
<li><span class="code">&lt;grid_lwd&gt;</span>: <span class="term">abline(lwd)</span> - line width - default value:
    <span class="term">1</span></li>
<li><span class="code">&lt;grid_x&gt;</span>: <span class="term">abline(v)</span> - list of positions for the gridlines
    - default value: <span class="term">listX</span></li>
<li><span class="code">&lt;x2tlab_orient&gt;</span>: <span class="term">axis(las)</span> - axis label orientation - 0:
    parallel to axis, 1: horiz, 2: perp to axis, 3: vert - default value: <span class="term">1</span></li>
<li><span class="code">&lt;x2tlab_perp&gt;</span>: <span class="term">axis(padj)</span> - axis label perpendicular
    location adjustment - default value: <span class="term">1</span></li>
<li><span class="code">&lt;x2tlab_horiz&gt;</span>: <span class="term">axis(hadj)</span> - axis label parallel location
    adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;x2tlab_size&gt;</span>: <span class="term">axis(cex)</span> - relative axis label
    magnification - default value: <span class="term">.8</span></li>
<li><span class="code">&lt;x2lab_weight&gt;</span>: <span class="term">mtext(font)</span> - 1: plain text, 2: bold, 3:
    italic, 4: bold italic and 5: symbol - default value: <span class="term">1</span></li>
<li><span class="code">&lt;x2lab_size&gt;</span>: <span class="term">mtext(cex)</span> - relative axis label
    magnification - default value: <span class="term">.8</span></li>
<li><span class="code">&lt;x2lab_offset&gt;</span>: <span class="term">mtext(padj)</span> - axis label perpendicular
    location adjustment - default value: <span class="term">-.5</span></li>
<li><span class="code">&lt;x2lab_align&gt;</span>: <span class="term">mtext(adj)</span> - axis label parallel location
    adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;y2tlab_orient&gt;</span>: <span class="term">axis(las)</span> - axis label orientation - 0:
    parallel to axis, 1: horiz, 2: perp to axis, 3: vert - default value: <span class="term">1</span></li>
<li><span class="code">&lt;y2tlab_perp&gt;</span>: <span class="term">axis(padj)</span> - axis label perpendicular
    location adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;y2tlab_horiz&gt;</span>: <span class="term">axis(hadj)</span> - axis label parallel location
    adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;y2tlab_size&gt;</span>: <span class="term">axis(cex)</span> - relative axis label
    magnification - default value: <span class="term">1</span></li>
<li><span class="code">&lt;y2lab_weight&gt;</span>: <span class="term">mtext(font)</span> - 1: plain text, 2: bold, 3:
    italic, 4: bold italic and 5: symbol - default value: <span class="term">1</span></li>
<li><span class="code">&lt;y2lab_size&gt;</span>: <span class="term">mtext(cex)</span> - relative axis label
    magnification - default value: <span class="term">1</span></li>
<li><span class="code">&lt;y2lab_offset&gt;</span>: <span class="term">mtext(padj)</span> - axis label perpendicular
    location adjustment - default value: <span class="term">1</span></li>
<li><span class="code">&lt;y2lab_align&gt;</span>: <span class="term">mtext(adj)</span> - axis label parallel location
    adjustment - default value: <span class="term">.5</span></li>
<li><span class="code">&lt;legend_size&gt;</span>: <span class="term">legend(size)</span> - relative magnification -
    default value: <span class="term">.8</span></li>
<li><span class="code">&lt;legend_box&gt;</span>: <span class="term">legend(bty)</span> - legend box type - o: box, n:
    none - default value: <span class="term">o</span></li>
<li><span class="code">&lt;legend_inset&gt;</span>: <span class="term">legend(inset)</span> - inset distance from margin
    - default value: <span class="term">c(0, -.25)</span></li>
<li><span class="code">&lt;legend_ncol&gt;</span>: <span class="term">legend(ncol)</span> - number of columns in legend
    - default value: <span class="term">3</span></li>
<li><span class="code">&lt;caption_weight&gt;</span>: <span class="term">mtext(font)</span> - 1: plain text, 2: bold, 3:
    italic, 4: bold italic and 5: symbol - default value: <span class="term">1</span></li>
<li><span class="code">&lt;caption_col&gt;</span>: <span class="term">mtext(col)</span> - font color - default value:
    <span class="term">#999999</span></li>
<li><span class="code">&lt;caption_size&gt;</span>: <span class="term">mtext(cex)</span> - relative magnification -
    default value: <span class="term">.8</span></li>
<li><span class="code">&lt;caption_offset&gt;</span>: <span class="term">mtext(padj)</span> - axis perpendicular
    location adjustment - default value: <span class="term">5</span></li>
<li><span class="code">&lt;caption_align&gt;</span>: <span class="term">mtext(adj)</span> - axis parallel location
    adjustment - 0:left, 1: right - default value: <span class="term">0</span></li>
<li><span class="code">&lt;box_pts&gt;</span>: <span class="term">points()</span> - draw points instead of boxes - TRUE:
    draw, FALSE: no draw - default value: <span class="term">FALSE</span></li>
<li><span class="code">&lt;box_outline&gt;</span>: <span class="term">boxplot(outline)</span> - draw outliers - TRUE:
    draw, FALSE: no draw - default value: <span class="term">TRUE</span></li>
<li><span class="code">&lt;box_boxwex&gt;</span>: <span class="term">boxplot(boxwex)</span> - scale factor to apply to
    all box widths - default value: <span class="term">1</span></li>
<li><span class="code">&lt;box_notch&gt;</span>: <span class="term">boxplot(notch)</span> - draw box notces - TRUE:
    notches on, FALSE: notches off - default value: <span class="term">FALSE</span></li>
<li><span class="code">&lt;box_avg&gt;</span>: <span class="term">points()</span> - draw box averages as asterisks -
    TRUE: on, FALSE: off - default value: <span class="term">FALSE</span></li>
<li><span class="code">&lt;rely_event_hist&gt;</span>: - draw histogram of events by threshold on reliability diagram -
    TRUE: draw, FALSE: no draw - default value: <span class="term">TRUE</span></li>
<li><span class="code">&lt;ci_alpha&gt;</span>: alpha value used to calculate the standard median error confidence
    intervals - default value: <span class="term">.05</span></li>
<br/>

<a name="fmt_series"></a>
The following group of settings should be set to lists of values where the length of each list is equal to the number of
series that are specified for the plot. Calculating
the number of series and furthermore, the order of the series, can be done by considering the series1, series2 and dep
values. For each dep1 statistic, enumerate each
series1 permutation. Then, do the same for each dep2 statistic.<br/><br/>

<li><span class="code">&lt;plot_ci&gt;</span>: confidence interval type for each series - options: none, norm, boot,
    brier, std - example: <span class="term">c("norm", "none")</span></li>
<li><span class="code">&lt;show_signif&gt;</span>: if the statistically significant CI's should be highlighted <span
        class="term">c(FALSE, TRUE)</span></li>
<li><span class="code">&lt;plot_disp&gt;</span>: indicates which series are visible or not using TRUE/FALSE - example:
    <span class="term">c(TRUE, FALSE)</span></li>
<li><span class="code">&lt;colors&gt;</span>: <span class="term">lines(col)</span> - line color for each series -
    example: <span class="term">c("#33FF00FF", "#00FF19FF")</span></li>
<li><span class="code">&lt;pch&gt;</span>: <span class="term">lines(pch)</span> - point symbol - see example:(points) -
    example: <span class="term">c(19, 19)</span></li>
<li><span class="code">&lt;type&gt;</span>: <span class="term">lines(type)</span> - series line type - p: points, l:
    lines, o: overplotted points and lines, b or c: points joined by lines, s or S: stair steps, h: histogram, n:
    nothing - example: <span class="term">c("b", "h")</span></li>
<li><span class="code">&lt;lty&gt;</span>: <span class="term">lines(lty)</span> - line type - 0: blank, 1: solid, 2:
    dashed, 3: dotted, 4: dotdash, 5: longdash, 6: twodash - example: <span class="term">c(1, 2)</span></li>
<li><span class="code">&lt;lwd&gt;</span>: <span class="term">lines(lwd)</span> - line width - example: <span
        class="term">c(2, 2)</span></li>
<li><span class="code">&lt;con_series&gt;</span>: if a series contains NAs, specifies whether to connect the points or
    not - 0: do not connect, 1: connect - example: <span class="term">c(0, 1)</span></li>
<br/>
<li><span class="code">&lt;legend&gt;</span>: legend labels for each series - example: <span class="term">c("series1", "series2")</span>
</li>

<li><span class="code">&lt;order_series&gt;</span>: the order of teh series - example: <span
        class="term">c(1, 2, 3)</span></li>

<a name="fmt_axis"></a>
<li><span class="code">&lt;x1_lim&gt;</span>: lower y axis (x1-axis) limits - example: <span class="term">c(10,15) or c("2017-05-10 00:00:00","2017-05-15 06:00:00") </span>
</li>
<li><span class="code">&lt;y1_lim&gt;</span>: left y axis (y1-axis) limits - example: <span class="term">c(0,5)</span>
</li>
<li><span class="code">&lt;y1_bufr&gt;</span>: left y axis (y1-axis) top and bottom buffer - example: <span
        class="term">.04</span></li>
<li><span class="code">&lt;y2_lim&gt;</span>: right y axis (y2-axis) limits - example: <span class="term">c(0,1)</span>
</li>
<li><span class="code">&lt;y2_bufr&gt;</span>: right y axis (y2-axis) top and bottom buffer - example: <span
        class="term">.04</span></li>
<li><span class="code">&lt;plot_cmd&gt;</span>: extra R commands to execute at the end of the plot script - example:
    <span class="term">par(usr=listY1Usr); abline(h=1, lty=1, col="#999999FF");</span></li>
<br/>
Elements specific to ROC curve:
<li><span class="code">&lt;add_point_thresholds&gt;</span>: <span class="code">TRUE</span> or <span
        class="code">FALSE</span>, indicating whether or not to display threshold points on the plot. The default value
    is TRUE (display threshold points).
</li>
<br/>
Elements specific to Rely plot:
<li><span class="code">&lt;add_skill_line&gt;</span>: <span class="code">TRUE</span> or <span class="code">FALSE</span>,
    indicating whether or not to display skill line on the graph. The default value is TRUE (display skill line).
</li>
<li><span class="code">&lt;add_reference_line&gt;</span>: <span class="code">TRUE</span> or <span
        class="code">FALSE</span>, indicating whether or not to display reference line on the graph. The default value
    is TRUE (display reference line).
</li>
<li><span class="code">&lt;create_html&gt;</span>: <span class="code">TRUE</span> or <span
        class="code">FALSE</span>, indicating whether or not to create HTML representation of the plot. Currently this
    option only available for Plotly plots, The default value is FALSE.
</li>


</ul>
</li><br/>
</ul>

<hr/>
<a name="mode_stat"></a>
<h2>Mode Statistics</h2>
<h3 style="padding-left:20px">Single Object Statistics</h3>
<p style="padding-left:40px">
    MODE statistics are broken up into two categories: single and pair statistics. Single statistics are suffixed with a
    three letter code which indicates the group of objects
    over which the statistic should be calculated or aggregated. The syntax for the three letter code is as follows:
    <span class="term">STATNAME_CCC</span> where
    <span class="term">STATNAME</span> is one of the Single Ojbect Statistics in the table below, and <span
        class="term">CCC</span> follows the following system:

<ul>
    <li><span class="term">[A|F|O|D]</span> - indicating All, Forecast, Observed or a Difference between the forecast
        statistic and the observed statistic
    </li>
    <li><span class="term">[A|S|C]</span> - indicating All, Simple or Cluster objects</li>
    <li><span class="term">[A|M|U]</span> - indicating All, Matched or Unmatched objects</li>
</ul>
</p>

<p style="padding-left:60px">
<table border="1" cellspacing="0">
    <tr>
        <th align="left">Single Object Stat</th>
        <th align="left">METviewer Stat Name</th>
    </tr>
    <tr>
        <td>SUM(area) / total</td>
        <td><span class="term">ACOV</span></td>
    </tr>
    <tr>
        <td>COUNT(object_id)</td>
        <td><span class="term">CNT</span></td>
    </tr>
    <tr>
        <td>COUNT(object_id)</td>
        <td><span class="term">CNTSUM</span></td>
    </tr>
    <tr>
        <td>centroid_x</td>
        <td><span class="term">CENTX</span></td>
    </tr>
    <tr>
        <td>centroid_y</td>
        <td><span class="term">CENTY</span></td>
    </tr>
    <tr>
        <td>centroid_lat</td>
        <td><span class="term">CENTLAT</span></td>
    </tr>
    <tr>
        <td>centroid_lon</td>
        <td><span class="term">CENTLON</span></td>
    </tr>
    <tr>
        <td>axis_avg</td>
        <td><span class="term">AXAVG</span></td>
    </tr>
    <tr>
        <td>length</td>
        <td><span class="term">LEN</span></td>
    </tr>
    <tr>
        <td>width</td>
        <td><span class="term">WID</span></td>
    </tr>
    <tr>
        <td>area</td>
        <td><span class="term">AREA</span></td>
    </tr>
    <tr>
        <td>area_threshold</td>
        <td><span class="term">AREATHR</span></td>
    </tr>
    <tr>
        <td>curvature</td>
        <td><span class="term">CURV</span></td>
    </tr>
    <tr>
        <td>curvature_x</td>
        <td><span class="term">CURVX</span></td>
    </tr>
    <tr>
        <td>curvature_y</td>
        <td><span class="term">CURVY</span></td>
    </tr>
    <tr>
        <td>complexity</td>
        <td><span class="term">CPLX</span></td>
    </tr>
    <tr>
        <td>intensity_10</td>
        <td><span class="term">INT10</span></td>
    </tr>
    <tr>
        <td>intensity_25</td>
        <td><span class="term">INT25</span></td>
    </tr>
    <tr>
        <td>intensity_50</td>
        <td><span class="term">INT50</span></td>
    </tr>
    <tr>
        <td>intensity_75</td>
        <td><span class="term">INT75</span></td>
    </tr>
    <tr>
        <td>intensity_90</td>
        <td><span class="term">INT90</span></td>
    </tr>
    <tr>
        <td>intensity_nn</td>
        <td><span class="term">INTN</span></td>
    </tr>
    <tr>
        <td>intensity_sum</td>
        <td><span class="term">INTSUM</span></td>
    </tr>
</table>
<br/>
</p>

<p style="padding-left:40px">
    In addition to the single object statistics, METviewer supports ratios of single object counts
    and areas, and also some contingency table statistics. These statistics are specified
    in the table below with their corresponding interpretation. For the area-weighted version of these statistics,
    replace <span class="term">RATIO_</span> with
    <span class="term">AREARAT_</span> and <span class="term">OBJ</span> with <span class="term">OBJA</span>.
</p>

<p style="padding-left:60px">
<table border="1" cellspacing="0">
    <tr>
        <th align="left">Interpretation</th>
        <th
                align="left">METviewer Stat Name
        </th>
    </tr>
    <tr>
        <td>What percentage of simple objects are forecast?</td>
        <td><span class="term">RATIO_FSA_ASA</span></td>
    </tr>
    <tr>
        <td>What percentage of simple objects are observation?</td>
        <td><span class="term">RATIO_OSA_ASA</span></td>
    </tr>
    <tr>
        <td>What percentage of simple objects are matched?</td>
        <td><span class="term">RATIO_ASM_ASA</span></td>
    </tr>
    <tr>
        <td>What percentage of simple objects are unmatched?</td>
        <td><span class="term">RATIO_ASU_ASA</span></td>
    </tr>
    <tr>
        <td>What percentage of simple forecast objects are matched?</td>
        <td><span class="term">RATIO_FSM_FSA</span></td>
    </tr>
    <tr>
        <td>What percentage of simple forecast objects are unmatched?</td>
        <td><span class="term">RATIO_FSU_FSA</span></td>
    </tr>
    <tr>
        <td>What percentage of simple observation objects are matched?</td>
        <td><span class="term">RATIO_OSM_OSA</span></td>
    </tr>
    <tr>
        <td>What percentage of simple observation objects are unmatched?</td>
        <td><span class="term">RATIO_OSU_OSA</span></td>
    </tr>
    <tr>
        <td>What percentage of simple matched objects that are forecast?</td>
        <td><span class="term">RATIO_FSM_ASM</span></td>
    </tr>
    <tr>
        <td>What percentage of simple matched objects that are observation?</td>
        <td><span class="term">RATIO_OSM_ASM</span></td>
    </tr>
    <tr>
        <td>What percentage of simple unmatched objects that are forecast?</td>
        <td><span class="term">RATIO_FSU_ASU</span></td>
    </tr>
    <tr>
        <td>What percentage of simple unmatched objects that are observation?</td>
        <td><span class="term">RATIO_OSU_ASU</span></td>
    </tr>
    <tr>
        <td>What percentage of all objects are simple?</td>
        <td><span class="term">RATIO_ASA_AAA</span></td>
    </tr>
    <tr>
        <td>What percentage of all objects are cluster?</td>
        <td><span class="term">RATIO_ACA_AAA</span></td>
    </tr>
    <tr>
        <td>What percentage of all forecast objects are simple?</td>
        <td><span class="term">RATIO_FSA_FAA</span></td>
    </tr>
    <tr>
        <td>What percentage of all forecast objects are cluster?</td>
        <td><span class="term">RATIO_FCA_FAA</span></td>
    </tr>
    <tr>
        <td>What percentage of all observation objects are simple?</td>
        <td><span class="term">RATIO_OSA_OAA</span></td>
    </tr>
    <tr>
        <td>What percentage of all observation objects are cluster?</td>
        <td><span class="term">RATIO_OCA_OAA</span></td>
    </tr>
    <tr>
        <td>What percentage of cluster objects are forecast?</td>
        <td><span class="term">RATIO_FCA_ACA</span></td>
    </tr>
    <tr>
        <td>What percentage of cluster objects are observation?</td>
        <td><span class="term">RATIO_OCA_ACA</span></td>
    </tr>
    <tr>
        <td>What is the ratio of simple forecasts to simple observations (frequency bias)?</td>
        <td><span class="term">RATIO_FSA_OSA</span></td>
    </tr>
    <tr>
        <td>What is the ratio of simple observations to simple forecasts (1 / frequency bias)?</td>
        <td><span class="term">RATIO_OSA_FSA</span></td>
    </tr>
    <tr>
        <td>What is the ratio of cluster objects to simple objects?</td>
        <td><span class="term">RATIO_ACA_ASA</span></td>
    </tr>
    <tr>
        <td>What is the ratio of simple objects to cluster objects?</td>
        <td><span class="term">RATIO_ASA_ACA</span></td>
    </tr>
    <tr>
        <td>What is the ratio of cluster forecast objects to simple forecast objects?</td>
        <td><span class="term">RATIO_FCA_FSA</span></td>
    </tr>
    <tr>
        <td>What is the ratio of simple forecast objects to cluster forecast objects?</td>
        <td><span class="term">RATIO_FSA_FCA</span></td>
    </tr>
    <tr>
        <td>What is the ratio of cluster observation objects to simple observation objects?</td>
        <td><span class="term">RATIO_OCA_OSA</span></td>
    </tr>
    <tr>
        <td>What is the ratio of simple observation objects to cluster observation objects?</td>
        <td><span class="term">RATIO_OSA_OCA</span></td>
    </tr>
    <tr>
        <td>Hits = (FSM + OSM)/2</td>
        <td><span class="term">OBJHITS</span></td>
    </tr>
    <tr>
        <td>Misses = OSU</td>
        <td><span class="term">OBJMISSES</span></td>
    </tr>
    <tr>
        <td>False Alarms = FSU</td>
        <td><span class="term">OBJFAS</span></td>
    </tr>
    <tr>
        <td>Correct Negatives (areas only) = [(TOT - FSA) + (TOT - OSA)] / 2</td>
        <td>(not implemented)</td>
    </tr>
    <tr>
        <td>CSI = hits / (hits + misses + false alarms) = [(FSM + OSM)/2] / [(FSM + OSM)/2 + OSU + FSU]</td>
        <td><span class="term">OBJCSI</span></td>
    </tr>
    <tr>
        <td>PODY = hits / (hits + misses) = [(FSM + OSM)/2] / [(FSM + OSM)/2 + OSU]</td>
        <td><span class="term">OBJPODY</span></td>
    </tr>
    <tr>
        <td>FAR = false alarms / (hits + false alarms) = FSU / [(FSM + OSM)/2 + FSU]</td>
        <td><span class="term">OBJFAR</span></td>
    </tr>
    <tr>
        <td>FBIAS = RATIO_FSA_OSA = FSA / OSA (a.k.a. RATIO_FSA_OSA above)</td>
        <td><span class="term">OBJFBIAS</span></td>
    </tr>
</table>
</p><br/><br/>


<h3 style="padding-left:20px">Pair Object Statistics</h3>
<p style="padding-left:40px">
    MODE object pair statistics are specified using the following format: <span class="term">STATNAME_CC</span> where
    <span class="term">STATNAME</span> is one of the Object
    Pair Statistics in the table below, and <span class="term">CC</span> follows the following system:

<ul>
    <li><span class="term">[A|S|C]</span> - indicating All, Simple or Cluster pairs</li>
    <li><span class="term">[A|M|U]</span> - indicating All, Matched or Unmatched objects</li>
</ul>
</p>

<p style="padding-left:60px">
<table border="1" cellspacing="0">
    <tr>
        <th align="left">Object Pair Stat</th>
        <th align="left">METviewer Stat Name</th>
    </tr>
    <tr>
        <td>centroid_dist</td>
        <td><span class="term">CENTDIST</span></td>
    </tr>
    <tr>
        <td>boundary_dist</td>
        <td><span class="term">BOUNDDIST</span></td>
    </tr>
    <tr>
        <td>convex_hull_dist</td>
        <td><span class="term">HULLDIST</span></td>
    </tr>
    <tr>
        <td>angle_diff</td>
        <td><span class="term">ANGLEDIFF</span></td>
    </tr>
    <tr>
        <td>area_ratio</td>
        <td><span class="term">AREARAT</span></td>
    </tr>
    <tr>
        <td>intersection_area</td>
        <td><span class="term">INTAREA</span></td>
    </tr>
    <tr>
        <td>union_area</td>
        <td><span class="term">UNIONAREA</span></td>
    </tr>
    <tr>
        <td>symmetric_diff</td>
        <td><span class="term">SYMDIFF</span></td>
    </tr>
    <tr>
        <td>intersection_over_area</td>
        <td><span class="term">INTOVERAREA</span></td>
    </tr>
    <tr>
        <td>complexity_ratio</td>
        <td><span class="term">CMPLXRATIO</span></td>
    </tr>
    <tr>
        <td>percentile_intensity_ratio</td>
        <td><span class="term">PERCINTRATIO</span></td>
    </tr>
    <tr>
        <td>interest</td>
        <td><span class="term">INT</span></td>
    </tr>
    <tr>
        <td>MAX(interest)</td>
        <td><span class="term">MAXINT</span></td>
    </tr>
    <tr>
        <td>MAX(interest) for fcst objects</td>
        <td><span class="term">MAXINTF</span></td>
    </tr>
    <tr>
        <td>MAX(interest) for obs objects</td>
        <td><span class="term">MAXINTO</span></td>
    </tr>
</table>
</p>


</body>
</html>
